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(54) Obstacle detection device for vehicle and method thereof 



(57) An obstacle detection device (1 0) for a vehicle 
that detects obstacles using a distance to an object cal- 
culated by image processing and a distance to the ob- 
ject calculated by radar ranging. This obstacle detection 
device (10) includes a measuring means (12,16) for 
measuring an amount of movement of the object at a 



predetermined interval of time by image processing and 
a measuring means (14) for measuring an amount of 
movement of the object at a predetermined interval of 
time by radar ranging, and does not determine the object 
to be an obstacle when the two amounts of movement 
are not consistent. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] The invention generally relates to an obstacle 
detection device for a vehicle, which is mounted in the 
vehicle, to help a driver become aware of obstacles and 
the like. More specifically, the invention relates to an ob- 
stacle detection device for a vehicle which minimizes the 
false recognition of objects that cause virtual images in 
a captured image. 

2. Description of the Related Art 

[0002] In recent years, the use of CCD cameras and 
millimeter wave radar has become widespread in order 
to help a driver become aware of obstacles and the like 
while driving. Typically, CCD cameras have the benefit 
of being able to detect lane markings and lights and the 
like on the road, but are inferior in terms of accuracy with 
far distances because they calculate distance using a 
captured image. On the other hand, millimeter wave ra- 
dar has the benefit of being extremely accurate with dis- 
tances, but can only detect objects that have a large re- 
flection coefficient. 

[0003] As a related obstacle detection device for a ve- 
hicle, an obstacle detection device for a vehicle such as 
that disclosed in Japanese Patent Laid-Open Publica- 
tion No. B-1 56723, for example, has been proposed. 
This obstacle detection device for a vehicle compares 
the distance to an object in front of the vehicle calculated 
from an image captured by a CCD camera with the dis- 
tance to the object ranged by the millimeter wave radar, 
and then recognizes the object as an obstacle when the 
distances match. This obstacle detection device for a 
vehicle makes use of the strong points of the CCD cam- 
era and the millimeter wave radar to make up for their 
weak points, thus enabling reliable recognition of an ob- 
stacle. 

[0004] This type of obstacle detection device for a ve- 
hicle compares the calculation results from the captured 
image with the measurement results from the millimeter 
wave radar at a predetermined interval of time (e.g., 
every 1s). When the results match such that a highly 
dangerous situation is detected, a warning is issued and 
the user is alerted. To prevent a collision, the user is 
alerted the instant that both the results match up and 
the obstacle enters an area where the danger of collision 
is high. 

[0005] Even with an obstacle detection device for a 
vehicle that uses both a CCD camera and millimeter 
wave radar, however, there is a possibility that an object, 
with which there is no danger of collision, may be erro- 
neously recognized as an obstacle due to a virtual im- 
age appearing on the image captured by the CCD cam- 
era. 



[0006] More specifically, when there is a puddle on the 
road, or when the road surface on which the vehicle is 
running tends to reflect light, such as the road itself at 
night, a virtuaMmage created by the reflection of the road 
5 surface may be captured on the image that is captured 
by the CCD camera. This virtual image is not a real ob- 
ject, and therefore will not be detected by the millimeter 
wave radar. 

[0007] When there is a metal object such as a can, or 
10 a road joint or an uneven portion of the road : or a piece 
of metal in the same location as this virtual image, how- 
ever, these are ranged by the millimeter wave radar. At 
this time, the calculation results from the captured image 
and the measurement results from the millimeter wave 
is radar are consistent, so the obstacle detection device 
for a vehicle may recognize these metal objects as ob- 
stacles and issue an erroneous warning. 
[0008] This type of erroneous warning may cause the 
user to distrust the obstacle detection device for a vehi- 
20 cle, thereby hurting the merchantability of the obstacle 
detection device for a vehicle. 

SUMMARY OF THE INVENTION 

[0009] Therefore, the invention thus provides an ob- 
stacle detection device for a vehicle capable of reliably 
discriminating between a virtual object of the kind de- 
scribed above and a real object, in which accuracy and 
reliability has been improved. 

[0010] In order to achieve the foregoing, an obstacle 
detection device for a vehicle according to one aspect 
of the invention is provided with a first measuring means 
and a second measuring means having a respectively 
different characteristic, and which determines a dis- 
tance between the vehicle and an object in the vicinity 
of the vehicle, and a controllerthat determines the object 
to be an obstacle if at least one of a displacement 
amount of the distance, displacement amount of a rela- 
tive velocity or displacement amount of a relative accel- 
eration between the object and the vehicle at a prede- 
termined interval that was determined by the first meas- 
uring means is consistent (i.e. substantially equal) with 
a distance between the obstacle and the vehicle that 
was determined by the second measuring means with 
the same timing as the measurement by the first meas- 
uring means. 

[0011] Also, an obstacle detection method of the ob- 
stacle detection device for a vehicle includes determin- 
ing by a first measuring means a distance between the 
vehicle and an object, determining by a second meas- 
uring means that has a different characteristic than the 
first measuring means the distance between the vehicle 
and the object, and determining the object to be an ob- 
stacle when the values determined in the first measuring 
step are consistent with the values obtained from the 
second measuring step. 

[0012] According to the aforementioned construction 
and method, erroneous recognition of the virtual image 
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created by a reflection on the road surface, as an obsta- 
cle, is able to be minimized even when the virtual image 
is recognized by captured image processing. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0013] The foregoing and further objects; features 
and advantages of the invention will become apparent 
from the following description of preferred exemplary 
embodiments with reference to the accompanying 
drawings, wherein like numerals are used to represent 
like elements and wherein: 

FIG. 1 is a block diagram of an obstacle detection 
device for a vehicle according to one exemplary em- 
bodiment of this invention; , 
FIG. 2A - 2B are diagrams Illustrating one exempla- 
ry embodiment of an image processing method of 
an image processing unit of the obstacle detection 
device for a vehicle shown in FIG. 1 ; 
FIG. 3 is a graph schematically showing a state of 
the vehicle and the object at time t « to and time t = 
to + AT; and 

FIG. 4 is a flowchart showing a process of an elec- 
tronic control unit of the obstacle detection device 
for a vehicle shown in FIG. 1 according to the inven- 
tion. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

[0014] FIG. 1 is a block diagram of an obstacle detec- 
tion device 1 0 for a vehicle according to one exemplary 
embodiment of the invention. This obstacle detection 
device 10 for a vehicle is provided with a CCD (stereo) 
camera (image capturing portion) 12 as imaging means, 
an image processing unit 1 6 connected to the CCD cam- 
era 12, a radar ranging portion 14 as radar ranging 
means, and an electronic control unit (ECU) 1 8 connect- 
ed to the image processing unit 1 6 and the radar ranging 
portion 14. A warning device 20 that issues a warning 
is also connected to this obstacle detection device 10 
for a vehicle. 

[001 5] The CCD camera 1 2 is mounted so as to cap- 
ture an Image of an area in front of the vehicle, e.g., the 
CCD camera 12 is fixed near the rearview mirror inside 
the vehicle cabin. The image data of the image (herein- 
after, this image will be referred to as "captured image") 
captured by the CCD camera 1 2 is sent to the image 
processing unit 16 at a predetermined interval of time. 
[0016] The radar ranging portion 14 is mounted so as 
to range an object in front of the vehicle, e.g. : the radar 
ranging portion 14 is mounted near the front grille of the 
vehicle. This radar ranging portion 1 4 is preferably a mil- 
limeter wave radar, which is relatively unaffected by 
weather conditions such as rain and fog, but may also 
be a laser radar. The radar ranging portion 14 emits ra- 
dar waves toward a predetermined area in front of the 



vehicle and receives the waves reflected off of objects 
in that predetermined area, thereby obtaining radar in- 
formation such as the velocity Vr, the distance Lr, and 
the direction 0r of the object. For example, with a two- 

5 frequency CW (Continuous Wave) method, the radar 
ranging portion 14 may calculate the velocity Vr using a 
radar wave Doppler frequency, or it may calculate the 
distance Lr from the phase information of the two fre- 
quencies. Also, the radar ranging portion 14 may one- 

10 dimensionally or two-dimensionally scan the emitted 
beam and detect the direction Br of the object. This radar 
information is then sent to the electronic control unit 1 8. 
[0017] The image processing unit 16 processes the 
image data from the CCD camera 12 and obtains the 

15 image information relating to the distance L, the direc- 
tion e, and the velocity V of the object in the captured 
image. This image information is sent to the electronic 
control unit 18. The image processing unit 16 may also 
recognize lane markings on the road and output only 

20 image information relating to the object in a specified 
area. 

[001 8] As will be described later in detail , the electron- 
ic control unit 1 B determines the consistency of the radar 
information from the radar ranging portion 14 with the 

25 image information from the image processing unit 16 
and determines an object relating to the consistent radar 
and image information to be an obstacle (an object with 
which the vehicle is in danger of colliding shall be re- 
ferred to as "obstacle" in this specification) with which 

30 the vehicle is in danger of colliding. 

[0019] Next, the image processing method of the im- 
age processing unit 16 will be described. The image 
processing method of the image processing unit 1 6 ap- 
plied to this invention presupposes the calculation of dis- 

35 tance from image data which does not include distance 
information. 

[0020] FIG. 2 is a diagram illustrating an exemplary 
embodiment of the image processing method of the im- 
age processing unit 1 6. FIG. 2A is a top view schemat- 

40 ically showing the view when capturing the image. FIG. 
2B is a view schematically showing the captured image 
corresponding to that view. FIG. 2B shows a virtual im- 
age VI of an object A on the captured image. This virtual 
image VI is created in the captured image by a reflection 

45 point B (e.g. a puddle) on the road shown In FIG. 2A. In 
FIG. 2A, a localized puddle Is shown to make It easier 
to visualize in the figure. In FIG. 2B, the captured image 
when the puddle extends all the way to the object A is 
shown. 

so [0021] The distance calculation method by the image 
processing unit 1 6 calculates the distance from the dif- 
ference on a two-dimensional coordinate system on the 
captured image containing a vanishing point P on the 
horizon. The distance calculation method also calcu- 

55 lates the distance with respect to the object A using the 
closest point from a reference line L of a real image Rl 
of the object A. That is, a distance C1 on the captured 
image is used in the distance calculation for the real im- 
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age Rl of the object A of the FIG. 2B. At this time, a 
distance L1 from the vehicle to the object A (see FIG. 
2A) is in proportion to the distance C1 on the captured 
image, and is able to be realized as a linear function with 
C1 as a variable such that L1 = f (C1 ). 
[0022] Similarly, a distance C2 on the captured image 
can also be used in the distance calculation for the vir- 
tual image V1 of the object A in FIG. 2B. At this time, a 
distance L2 from the vehicle to the reflection point B (see 
FIG 2A) is in proportion to the distance C2 on the cap- 
tured image, and is able to be realized as a linear func- 
tion with C2 as a variable such that L2 = f (C2). 
[0023] The velocity calculation method by the image 
processing unit 16 is based on the distance calculation 
method. That is, when the real image Rl of the object A 
has moved only a distance AC1 on the captured image 
in an interval of time AT, an amount of movement Vc1 
of the real image Rl of the object A per unit of time on 
the captured image is expressed as Vc1 = A C1/AT. At 
this time, a velocity V1 = AL1/AT (AL1 is the amount that 
the object A moved with respect to the vehicle in the 
interval of time AT) of the object A with respect to the 
vehicle can be expressed as a linear function with Vc1 
as a variable such that V1 = g (Vc1). This is based on 
thefactthatthe distance L1 from the vehicle to the object 
A is in proportion to the distance C1 on the captured 
image, as described above. 

[0024] Similarly, with respect to the virtual image VI ot 
the object A as well, when the virtual image VI of the 
object A has moved only a distance AC2 on the captured 
image in the interval of time AT, an amount of movement 
Vc2 of the virtual image VI of the object A per unit of 
time on the captured image is expressed as Vc2 = A 
C2/AT. At this time, a velocity V2 = AL2/AT (AL2 is the 
amount that the reflection point B moved with respect to 
the vehicle in the interval of time AT) of the reflection 
point B with respect to the vehicle can be expressed as 
a linear function with Vc2 as a variable such that V2 = 
g (Vc2). 

[0025] The direction calculation method by the image 
processing unit 1 6 calculates using two-dimensional co- 
ordinates on the captured image. That is, this direction 
calculation method calculates both the vector from the 
location of the vehicle to the real image Rl of the object 
A and the vector from the location of the vehicle to the 
virtual Image VI of the object A, and then derives the 
direction ei of the real image Rl and the direction 62 of 
the virtual image VI with respect to the vehicle. 
[0026] The thus obtained distance L1 , the velocity V1 , 
and the direction G1 relating to the real image Rl are 
consistent with the respective distance Lr1 , the velocity 
Vr1 , and the direction 6r1 relating to the object A of the 
radar information. The term "consistent" in this specifi- 
cation is used in view of the fact that the value of the 
radar information and the value of the captured image 
will not match due to differences of calculation accuracy 
and the like. Therefore, the term "consistent" shall be 
considered to also include cases in which both values 



correspond in some manner, he., both values will be 
substantially equal in some matter. 
[0027] In contrast, the radar ranging portion 1 4 funda- 
mentally does not range the reflection point B such as 
5 a puddle. Accordingly, information consistent with the 
distance L2, the velocity V2, andthe direction 62 relating 
to the virtual image VI does not exist in the radar infor- 
mation of the radar ranging portion 14. As a result, the 
electronic control unit 18 does not determine the virtual 
10 image VI (reflection point B) to be an obstacle so a prob- 
lem does not normally occur. 

[0028] In addition to objects that will become obsta- 
cles such as cars ahead and fallen objects, however, 
the radar ranging portion 14 outputs radar information 
is regarding objects that will not become obstacles (here- 
inafter, this type of object shall be referred to as "non- 
obstacle C), such as metal objects such as cans and 
steel sheet joints where roads and bridges meet andthe 
like. Accordingly, when the obstacle detection device 10 
20 for a vehicle is constructed to confirm the consistency 
of only information relating to the distance and direction 
between the radar information and the image informa- 
tion, as with the related art, that obstacle detection de- 
vice 10 for a vehicle would erroneously recognize the 
25 non-object C as an obstacle when the non-object C is 
in the same location as the reflection point B. 
[0029] On the other hand, with the obstacle detection 
device 10 for a vehicle, this kind of erroneous recogni- 
tion is able to be minimized because the obstacle de- 
30 tection device 1 0 confirms the consistency, between the 
radar information and the image information, of the in- 
formation relating to velocity as well as the consistency 
of the information relating to the distance and direction. 
This is based on the fact that the velocity V2 relating to 
35 the virtual image V (i.e., the reflection point B) in the im- 
age information is not consistent with a velocity Vr3 re- 
lating to the non-obstacle C in the radar information. 
[0030] Next, the reason why the velocity V2 relating 
to the virtual image VI in the image information is not 
40 consistent with the velocity Vr3 relating to the non-ob- 
stacle C in the radar information will be explained in de- 
tail. 

[0031] Tne upper graph in FIG. 3 schematically shows 
the states Df the object A, the reflection point B, and the 
45 non-object C with respect to the CCD camera 1 2 at time 
t = to. The lower graph in FIG. 3 schematically shows 
the states of the object A, the reflection point B, and the 
non-object C with respect to the CCD camera 1 2 at time 
t = to + AT. To facilitate understanding, the height HC of 
so the CCD camera 1 2 and the height HA of the obstacle 
A shall be made the same. Also, AL1 and AL3 in the 
lower graph of FIG. 3 denote the amounts of movement 
(the direction approaching the vehicle shall be positive) 
of the object A and the non-object C, respectively, with 
55 respect to the vehicle after the interval of time AT has 
passed. Accordingly, supposing that the non-object C is 
a stationary object, AL3 would show the absolute 
amount of movement of the vehicle at the interval of time 
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AT. 

[0032] The reflection point B always exists at a point 
midway between the CCD camera 12 and the object A, 
so the amount of movement AL2 of the reflection point 
B after the interval of time AT has passed becomes AL2 
= AL1/2. This AL2 is normally very different from AL3. 
For example, when AT = 0.1s, the absolute velocity of 
the object A (assumed to be a preceding vehicle) is 40 
km/h, and the absolute velocity of the vehicle is 60 km/ 
h, then AL2 = 0.278m and AL3 = 1 .667m. 
[0033] This difference becomes more evident the 
greater the absolute velocity of the object A. When the 
absolute velocity of the object A becomes greater than 
the absolute velocity of the vehicle , the amount of move- 
ment AL2 of the reflection point B becomes negative and 
the difference becomes even more apparent. On the 
other hand, this difference becomes less the lower the 
absolute velocity of the object A. However, even If the 
absolute velocity of the object A is zero (i.e., even if the 
object A is stationary), the amount of movement AL2 of 
the reflection point B has a difference of AL3/2 with re- 
spect to the amount of movement AL3 of the non-object 
C. 

[0034] Accordingly, because the difference between 
the amount of movement AL2 and the amount of move- 
ment AL3 is sufficiently large, the difference between the 
amount of movement Vc2 of the reflection point B (or 
more accurately, of the virtual image VI relating to the 
object A) per unit of time in the captured image and the 
amount of movement Vc3 of the non-obstacle C (or 
more accurately, the real image Rl relating to the non- 
obstacle C) per unit of time becomes sufficiently evident 
even considering the relatively low accuracy of the im- 
age processing unit 16. 

[0035] Therefore, the velocity V2 relating to the ref lec- 
tion point B in the image information becomes largely 
differentfrbm the velocity V3 relatingto the non-obstacle 
in the image information, as is evident from the propor- 
tionality relation of V2 eg (Vc2). This velocity V3 is con- 
sistent with the velocity Vr3 relating to the non-obstacle 
C of the radar information, so it is understandable that 
the velocity V2, which is largely different from the veloc- 
ity V3, is largely different from the velocity Vr3 (i.e., the 
velocity V2 will not be consistent with the velocity Vr3). 
[0036] In this way, because the velocity V2 of the re- 
flection point B largely differs from the velocity Vr3 of the 
non-obstacle C, the obstacle detection device 10 for a 
vehicle according to this invention is able to reliably 
identity the difference between the reflection point B and 
the non-obstacle C at time t = to + AT, regardless of 
whether the reflection point B and the non-obstacle C 
are in the same location. 

[0037] Next, the process of the electronic control unit 
18 of the obstacle detection device 10 for a vehicle ac- 
cording to the invention will be described in detail. FIG. 
4 is a flowchart showing a process of the electronic con- 
trol unit 18. The electronic control unit 18 receives radar 
information and image information at a predetermined 



interval of time AT This process starts when the ignition 
switch is turned ON. 

[0038] In step 100, the electronic control unit 18 de- 
termines whether the distance and direction of the radar 

5 information are consistent with the distance and direc- 
tion of the image information. When consistency cannot 
be confirmed, for example, in the case where time t = to 
shown in the upper graph of FIG. 3, the electronic control 
unit 18 determines that an obstacle does not exist. 

10 When consistency is able to be confirmed, however, for 
example, in the case where time t = to + AT shown in 
the lower graph of FIG. 3, the process proceeds on to 
step 102. 

[0039] In step 102, the electronic control unit 18 de- 
i5 termines whether the velocity of the radar information 
and the velocity of the image information are consistent. 
When consistency Is able to be confirmed, the process 
proceeds on to step 1 04. 

[0040] In step 1 04, the electronic control unit 1 8 de- 
20 termines the object A relating to the radar information 
and image information that are consistent to be an ob- 
stacle. At this time, it is preferable that the electronic 
control unit 1 8 further determine whether a warning 
should be issued considering the velocity of the vehicle, 
25 along with the location and velocity of the obstacle. Al- 
ternatively, the electronic control unit 18 may also send 
the determination results to a warning determination cir- 
cuit that determines whether a warning should be is- 
sued. In this case, the warning determination circuit de- 
30 termines whether a warning should be issued consider- 
ing the velocity of the vehicle, along with the location 
and velocity of the obstacle. The velocity of the vehicle 
may be input to the electronic control unit 1 8 from a ve- 
hicle speed sensor (not shown) that is connected to the 
35 electronic control unit 18. When the electronic control 
unit 1 8 has ultimately determined that a warning should 
be issued, ft sends a signal to the warning device 20 
instructing the warning device 20 to issue a warning. 
[0041] On the other hand, when consistency cannot 
40 be confirmed in step 102, the electronic control unit 18 
determines that an obstacle does not exist. Accordingly, 
erroneous recognition of the non-obstacle C as an ob- 
stacle can be reliably minimized even when the distance 
and direction of the reflection point B and the distance 
45 and direction of the non-object C are consistent (e.g., 
time t = to + AT shown in the lower graph of FIG. 3). 
[0042] In this way, according to the obstacle detection 
device 10 for a vehicle of this invention, determination 
of whether the object A is an obstacle is made by deter- 
50 mining the consistency between the velocity of the radar 
information and the velocity of the image information, as 
well as the consistency between the distance and direc- 
tion of the radar information and the distance and direc- 
tion of the image information. Therefore, erroneous de- 
55 termination caused by the reflection point B on the road 
is able to be reliably minimized. 

[0043] Also, according to the obstacle detection de- 
vice 1 0 for a vehicle of this invention, because the de- 
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termination of whether the object A is an obstacle is able 
to be made the instant (t = to + AT) consistency between 
the distance and direction of the radar information and 
the distance and direction of the image information is 
able to be confirmed., a warning is also able to be issued 
at that instant (t = to + AT). That is, there is no need for 
a process to prevent erroneous determination, such as 
a process to confirm whether consistency is still being 
maintained during a predetermined period of time (e.g., 
t = to + 3ATj from the time (t = to + AT) consistency of 
the distance and direction between the radar informa- 
tion and the image information was able to be confirmed. 
This type of process to prevent an erroneous determi- 
nation not only causes a delay in the issuance of a warn- 
ing which is undesirable from the viewpoint of ensuring 
passenger safety, but also increases the processing 
load on the electronic control unit 18. 
[0044] The foregoing exemplary embodiment is 
based on the fact that the amount of movement AL2 or 
the reflection point B differs enough from the amount of 
movement AL3 of the non-obstacle C to be able to com- 
pensate for the relatively low distance calculation accu- 
racy of the image processing unit 1 6. With the obstacle 
detection device 1 0 for a vehicle according to this inven- 
tion, however, even in an exceptionally rare case in 
which there is almost no difference between the amount 
of movement AL2 of the reflection point B and the 
amount of movement AL3 of the non-obstacle C, prob- 
lems do not occur. 

[0045] Referring back to FIG. 3, this exceptional case 
occurs when the amount of movement AL3 of the non- 
obstacle C in the interval of time AT is substantially equal 
to the amount of movement AL2 (= AL1/2) of the reflec- 
tion point B, i.e., when AL3 « AL1/2. In this case, the 
amount of absolute movement of the vehicle in the in- 
terval of time AT becomes approximately AL1/2. This is 
an extremely rare case in which the object A approaches 
(if the object A is a vehicle, that object A is running at 
the same speed as, but in the opposite direction of, the 
vehicle) the vehicle at an absolute velocity of approxi- 
mately AL1/2AT, but nonetheless a case in which a col- 
lision needs to be avoided. In this case, even though the 
electronic control unit 18 erroneously recognizes the 
non-obstacle C to be an obstacle In step 104, there is 
not a problem with the warning being issued. If anything, 
the issued warning is effective in an extremely danger- 
ous situation. 

[0046] Further, another exceptional case occurs 
when both the absolute velocity of the object A and the 
absolute velocity of the vehicle are extremely low. For 
example, when the absolute velocity of the object A is 
zero.the amount of movement AL2 of the reflection point 
B has a difference of AL3/2 with respect to the amount 
of movement AL3 of the non-obstacle C. However, when 
the AL3 becomes extremely low, i.e., when the vehicle 
is running at an extremely slow speed, the difference 
(AL3/2) is extremely small. In this case, even though the 
electronic control unit 18 erroneously recognizes the 



non-obstacle C as an obstacle instep 1 04, the electronic 
control unit 1 8 determines whether a warning should ul- 
timately be issued considering the velocity of the vehicle 
so an erroneous warning will not be issued. 
5 [0047] The "first measuring portion" as a measuring 
device is realized by the image processing unit 16 dis- 
closed in the exemplary embodiment. Also, in the same 
way the "second measuring portion" is realized by the 
radar ranging portion 1 4 disclosed in the exemplary em- 
10 bodiment. Further, the "control portion" as a controller 
corresponds to the electronic control unit 1 8. 
[0048] Although the invention has been described 
herein with reference to specific embodiments, many 
modifications and variations therein can be controlled. 
15 Accordingly, all such variations and modifications are in- 
cluded within the intended scope of the invention. 
[0049] The image processing method of the image 
processing unit 16 was described above with reference 
to FIG. 2. It is lo be understood, however, that the image 
20 processing method of the image processing unit 1 6 is 
in no way limited to this. For example, the distance cal- 
culation method of the image processing unit 16 may 
also obtain the distance to the object A by captunng the 
view using two of the CCD cameras 12 and obtaining 
25 the parallax between the captured images. In this case, 
the distance in the captured image may be calculated 
by a relational expression of distance = focal point of the 
lenses x distance between the cameras /parallax. 
[0050] Also, the foregoing exemplary embodiment 
30 recognizes a difference between the virtual image and 
the object using the fact that the amount of movement 
of the virtual image on the image greatly differs from the 
amount of movement of the object that is in the same 
location as the virtual image. Alternatively, however, the 
35 difference between the virtual image and the real image 
can be recognized using the fact that the amount of 
movement of the virtual image on the image is half of 
the amount of movement of the real image relating to 
the virtual image (see the lower graph in FIG. 3). In this 
40 case, the information relating to the virtual image from 
the image information may also be excluded beforehand 
at the stage where a difference between the virtual im- 
age and the real image is recognized. 
[0051] The foregoing exemplary embodiment com- 
45 pares a displacement amount of the distance from the 
vehicle to the object at a predetermined interval of time 
by image processing and a displacement amount of the 
distance from the vehicle to the object at a predeter- 
mined interval of time by radar ranging. Alternatively, a 
so displacement amount of a relative velocity or a relative 
acceleration at a predetermined interval of time, instead 
of the displacement amount of the distance. 
[0052] The invention as described above has the fol- 
lowing effects. According to one aspect of the invention, 
55 erroneous recognition of a virtual image caused by a re- 
flection on the road surface is able to be minimized, even 
if that virtual image is recognized by the captured image 
processing. That is. because the difference between the 
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virtual image and the object is able to be reliably recog- 
nized using the fact that the amount of movement of the 
virtual image on the image greatly differs from the 
amount of movement of the object which is real, the ob- 
ject (or virtual image) will not be erroneously recognized 
as an obstacle even if the distance of the virtual image 
calculated by the captured image processing is consist- 
ent with the distance of the object calculated by the radar 
ranging. As a result, the obstacle detection device for a 
vehicle is not affected by virtual images, and therefore 
can recognize obstacles with high reliability. 
[0053] Moreover, if necessary, at the instant the dis- 
tance calculated by the captured image processing and 
the distance calculated by radar ranging are consistent, 
and the amount of movement calculated by the captured 
image processing and the amount of movement calcu- 
lated by radar ranging are consistent, a warning can be 
issued to alert the user. That Is, correct recognition can 
be instantly carried out wilhoul the need for a process 
of monitoring for a given period of time the consistency 
between the distance calculated by the captured image 
processing and the distance calculated by radar ranging 
in order to minimize erroneous recognition. As a result, 
it is possible to instantly alert the user in an emergency 
and obtain high accuracy without increasing the 
processing load. 

[0054] The ECU 18 of the illustrated exemplary em- 
bodiments is implemented as one or more programmed 
general purpose computers. It will be appreciated by 
those skilled in the art that the controller can be imple- 
mented using a single special purpose integrated circuit 
(e.g., ASIC) having a main or central processor section 
for overall, system-level control, and separate sections 
dedicated to performing various different specific com- 
putations, functions and other processes under control 
of the central processor section. The controller can be 
a plurality of separate dedicated or programmable inte- 
grated or other electronic circuits or devices (e.g., hard- 
wired electronic or logic circuits such as discrete ele- 
ment circuits, or programmable logic devices such as 
PLDs, PLAs, PALs or the like). The controller can be 
implemented using a suitably programmed general pur- 
pose computer, e.g., a microprocessor, microcontroller 
or other processor device (CPU or MPU) t either alone 
or in conjunction with one or more peripheral (e.g., inte- 
grated circuit) data and signal processing devices. In 
general, any device or assembly of devices on which a 
finite state machine capable of implementing the proce- 
dures described herein can be used as the controller. A 
distributed processing architecture can be used for max- 
imum data/signal processing capability and speed. 
[0055] While the invention has been described with 
reference to preferred exemplary embodiments thereof, 
it is to be understood that the invention is not limited to 
the disclosed embodiments or constructions. On the 
contrary, the invention is intended to cover various mod- 
ifications and equivalent arrangements. In addition, 
while the various elements of the disclosed invention are 
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shown in various combinations and configurations, 
which are exemplary, other combinations and configu- 
rations, including more less or only a single element, are 
also within the spirit and scope of the invention. 

5 

Claims 

1 . An obstacle detection device for a vehicle, charac- 
ter terized by comprising: 

a first measuring means (12,16) for determining 
a distance between the vehicle and an object 
in a vicinity of the vehicle; 

is a second measuring means (14) for determin- 

ing a distance between the vehicle and the ob- 
ject in the vicinity of the vehicle and has a dif- 
ferent characteristic than the first measuring 
means (12,16); and 

20 a controller (1 8) that determines that the object : 

is an obstacle when: 

the distance (L) between the vehicle and 
the object determined by the first measur- 
es ing means (12,1 6) and the distance (Lr) be- 
tween the vehicle and the object deter- 
mined by the second measuring means 
(1 4) with the same timing used by the first 
measuring means (12,16) are consistent, 
30 and 

at least one of a displacement amount of 
the distance, a displacement amount of a 
relative velocity and a displacement 
amount of a relative acceleration at a pre- 
35 determined interval of time from the vehicle 

to the object determined by the first meas- 
uring means (12,16) and a corresponding 
at least one of a displacement amount of 
the distance, a displacement amount of the 
40 relative velocity and a displacement of the 

relative acceleration from the vehicle to the 
object determined by the second measur- 
ing means (14) with the same timing used 
-by the first measuring means (12.16) are 
45 consistent. 

2. The obstacle detection device for a vehicle accord- 
ing to claim 1 or 2, 
characterized in that 

so the first measuring means (12,16) determines 

the distance to the object and the at least one of the 
displacement amount of the distance, the displace- 
ment amount of the relative velocity and the dis- 
placement of the relative acceleration at a predeter- 

55 mined interval of time by image processing and the 
second measuring means (14) determines the dis- 
tance to the object and the at least one of the dis- 
placement amount of the distance, the displace- 
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ment amount of the relative velocity and the dis- 
placement of the relative acceleration at the prede- 
termined interval of time by radar ranging. 

3. The obstacle detection device for a vehicle accord- 
ing to claim 2, characterized in that 

the radar ranging is conducted with a millim- 
eter wave radar. 

4. The obstacle detection device for a vehicle accord- 
ing to claim 2, characterized in that 

the radar ranging is conducted with a laser ra- 
dar. 

5. The obstacle detection device for a vehicle accord- 
ing to claim 2, characterized in that 

the image of the image processing is captured 
by at least one camera. 

6. The obstacle ^detection device for a vehicle accord- 
ing to any one of claim 1 to 5, characterized by 
further comprising in that: 

a warning device (20) that operates when the 
controller (18) has determined that the object 
is an obstacle. 

7. The obstacle detection device for a vehicle accord- 
ing to claim 6, wherein the controller (18) deter- 
mines the objectto be an obstacle and activates the 
warning device characterized in that: 

the distance and a direction of the object deter- 
mined by the first measuring and the distance 
and a direction of the object determined by the 
second measuring means (14) are consistent, 
respectively, and 

the at least one of the displacement amount of 
the distance, the displacement amount of the 
relative velocity and the displacement of the rel- 
ative acceleration determined by the first meas- 
uring means (12,16) and the at least one of the 
displacement amount of the distance, the dis- 
placement amount of the relative velocity and 
the displacement of the relative acceleration 
determined by the second measuring means 
(14) are consistent. 

8. An obstacle detection method of an obstacle detec- 
tion device for a vehicle, characterized by compris- 
ing: 

determining, by a first measuring method, a dis- 
tance between the vehicle and an object in a 
vicinity of the vehicle, and at least one of a dis- 
placement amount of that distance, a displace- 
ment amount of a relative velocity and a dis- 
placement amount of a relative acceleration; 



determining, by a second measuring method 
that has a different characteristic than the first 
measuring method with the same timing used 
by the first measuring method, a distance be- 

5 tween the vehicle and the object in the vicinity 

of the vehicle and at least one of a displacement 
amount of that distance, a displacement 
amount of a relative velocity or a displacement 
amount of a relative acceleration; and 

10 determining the object to be an obstacle when: 

the distance between the vehicle and the 
objection determined in the first measuring 
step and the distance between the vehicle 

is and the objection determined in the second 

measuring step are consistent, and 
at least one of a displacement amount of 
the distance, a displacement amount of a 
relative velocity and a displacement mount 

20 of a relative acceleration determined in the 

first measuring step and a displacement 
amount of the distance, a displacement 
amount of a relative velocity and a dis- 
placement mount of a relative acceleration 

25 determined in the second measuring step 

are consistent. 

9. The detection method according to claim 8, char- 
acterized in that 
30 the first measuring method is a determining 

method by image processing and the second meas- 
uring method is a determining method by radar 
ranging. 

35 10. The detection method according to claim 8, charac- 
terized further comprising in that: 

issuing a warning when the object has been de- 
termined as an obstacle in the determining 
40 step. 

11. The detection method according to claim 9, char- 
acterized by further comprising the steps of: 

45 determining whether the distance between the 

vehicle and the object in the vicinity of the ve- 
il icle and the direction of the object with respect 
to the vehicle, which were determined in the 
first measuring step, are consistent with the dis- 

so tance between the vehicle and the object in the 

vicinity of the vehicle and the direction of the 
object with respect to the vehicle, which were 
determined in the second measuring step; 
determining, when the distances and directions 

55 are consistent, whether the relative velocity of 

the vehicle and the object, which was deter- 
mined in the first measuring step, are consist- 
ent with the relative velocity of the vehicle and 
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the object, which was determined in the second 
measuring step; and 

issuing a warning when the velocities are con- 
sistent. 

12. An obstacle detection device for a vehicle that de- 
tects an obstacle using a distance to an object cal- 
culated by image processing and a distance to the 
object calculated by radar ranging, characterized 
by comprising: 



10 



15 



af irst measuring means (12,16) that calculates, 
by image processing, a displacement amount 
of the distance from the vehicle to the object at 
a predetermined interval of time; 
a second measuring means (14) that calcu- 
lates, by radar ranging, a displacement amount 
of the object at the predetermined interval of 
time; and 

a controller (1 8) that determines the object to 20 
be an obstacle when the two displacement 
amounts are consistent. 

13. An obstacle detection method by an obstacle de- 
tection device for a vehicle, characterized by com- 25 
prising the steps of: 

calculating, by image processing, a displace- 
ment amount of an object at a predetermined 
interval of time; 30 
calculating, by radar ranging, a displacement 
amount of the object at the predetermined in- 
terval of time; 

comparing the displacement amount at a pre- 
determined interval time of the object calculat- 35 
ed by the imaging processing with the displace- 
ment amount at a predetermined interval of 
time of the object measured by the radar rang- 
ing; and 

determining the object to be an obstacle when 40 
the displacement amounts are consistent. 
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